Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens
نویسندگان
چکیده
Substantial evidence suggests that the phasic activity of dopamine neurons represents reinforcement learning's temporal difference prediction error. However, recent reports of ramp-like increases in dopamine concentration in the striatum when animals are about to act, or are about to reach rewards, appear to pose a challenge to established thinking. This is because the implied activity is persistently predictable by preceding stimuli, and so cannot arise as this sort of prediction error. Here, we explore three possible accounts of such ramping signals: (a) the resolution of uncertainty about the timing of action; (b) the direct influence of dopamine over mechanisms associated with making choices; and (c) a new model of discounted vigour. Collectively, these suggest that dopamine ramps may be explained, with only minor disturbance, by standard theoretical ideas, though urgent questions remain regarding their proximal cause. We suggest experimental approaches to disentangling which of the proposed mechanisms are responsible for dopamine ramps.
منابع مشابه
Mode of sucrose delivery alters reward-related phasic dopamine signals in nucleus accumbens
متن کامل
Relationship of Dopamine of the Nucleus Accumbens with Intra-infralimbic Apomorphine Microinjection
Objective(s): The dopamine level of the nucleus accumbens changes during some stereotyped behaviors. To study dopamine level of the nucleus accumbens in intra infralimbic apomorphine-induced climbing, microdialysis probes were implanted into the nucleus accumbens shell of male Sprague Dawley rats weighting 275–400 g. Materials and Methods: The rats were divided into two groups (apomorphine ...
متن کاملPhysiological state gates acquisition and expression of mesolimbic reward prediction signals.
Phasic dopamine signaling participates in associative learning by reinforcing associations between outcomes (unconditioned stimulus; US) and their predictors (conditioned stimulus; CS). However, prior work has always engendered these associations with innately rewarding stimuli. Thus, whether dopamine neurons can acquire prediction signals in the absence of appetitive experience and update them...
متن کاملDopamine Ramps Are a Consequence of Reward Prediction Errors
Temporal difference learning models of dopamine assert that phasic levels of dopamine encode a reward prediction error. However, this hypothesis has been challenged by recent observations of gradually ramping stratal dopamine levels as a goal is approached. This note describes conditions under which temporal difference learning models predict dopamine ramping. The key idea is representational: ...
متن کاملControls of tonic and phasic dopamine transmission in the dorsal and ventral striatum.
Dopamine (DA) release varies within subregions and local environments of the striatum, suggesting that controls intrinsic and extrinsic to the DA fibers and terminals regulate release. While applying fast-scan cyclic voltammetry and using tonic and phasic stimulus trains, we investigated the regulation of DA release in the dorsolateral to ventral striatum. The ratio of phasic-to-tonic-evoked DA...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره 11 شماره
صفحات -
تاریخ انتشار 2015